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ABSTRACT 


seven short-term forecastinea mode [seb omc ieee crs 
saquares estimation methods and five employing variations of 
the exponentially weighted moving average method, are com- 
ened in their redative adility tosprodijec seman tilneecmmons 
wirtance forecasts £0r Seven simulateae time Set ilcs ames aer 
mertics WAS SeEnerTrated to Cnaple onewer tne aOreGast models 
Mmombic tie Least sduarcdmerror predictor. A Comparison 
methodology is developed which facilitates forecast model 
Selection based on single or sroup Series forecast per- 
momllance through the measurement of model specification 


Smnors. A computer program 1s presented which may be 
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morecast models to be ranked in order of their relative 


eeecification error. 
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TABLE OF SYMBOLS AND ABBREVIATIONS 


Following are the meanings of thesiotarveneie>s aero. 


quently used throughout this thesis. 


i‘ = the estimate or forecast 7os seme usenm ce ie aan Oe 
of a random process es at time t. 

Y, =the €stimate or forecast of tie wlevei ot Mie anm ane 
oe) at time t of the process ee made at time t. 

b, = the estimate at time t-l of the process slope (b,) 
Ateame. totnecy Linear sodden 

. Si Tandon siloce Of SUpPeTIMmposed eCrlor expe pele camm, 
tne “andom process at time t Which contrrputccmromenc 
error in forecasting the observed value. 

F. = the one step ahead forecast at time t-1 of the as 
Ve Cminem se te dace T Teo my duller pea 

e. = Pic mmOnc sore) iTC dmet@ Ge Gas trCHmien: (e, = Y,7F,) which 
Poerealrzcdsiwiene thes obseryal ron We 1S ee aken- 

a =eetie SnOOthing constant in a EMA model. @Alse jars 
the portion of a random shock which is ponenaece to 
Dewadapermanent Contrabutron to process eve ls cesar 

B = the discounting factor in an EWMA model; the rate at 
Wien the wete¢mtmpiyen tGolpast ODServations dintmacmes, 
Seeley 

r= the smoothing constant associated with the slope es= 
timator of a forecast model. 

oeee= the discounting tactonm adssociaced With tne orcemce 


model slope estimator. —° 15 mot necess@rily equalste 


So 4 





Me me stile tes Os Bo» the slope of the wine anode ima 
least squares methodology. 

the autocorrelation coefficient of the series {Y,} 
wath Lac Of Ome perma od. 


the measure of model specitrved _lomecune ne 





I. ANDEORU Cie) 


When a random event has a significant impact on 
society, considerable effort will be made to predict its 
occurrence. The ability to predict O1rmtorcedstectchmam 
event is a by-product of a quantitative understanding of 
fae Similation, @ physical model. Prediction based upom 
a behavioral model is the ideal, but forecasts can also 
be based upon recognition of regularity as well as upon 
eeplanation of that regularity. 

There are many situations in both industrial and 
movermmnental operations which recuire forecasts for hun- 
dreds or thousands of routinely recurring events. Often 
Merc SyCuis, Sach as equipmen 
demands for repair parts, are not influenced by adver- 
Mmoing or other factors. In the absence of additional 
Preormatilon a projection into the future must be made 
based entirely upon past observations of these events. 
It is frequently true that none of the events, individ- 
ually, are of sufficient importance to warrant the study 
maaeattention required to develop behavioral models: 

For these items of low cost and nonsensitive nature a 
routine forecasting system is desired which employs the 
"management by exception" principle. In evaluating the 
horecast accuracy of such systems, a cost-effectiveness 
approach must be taken. A forecast model which performs 


well in one application may be totally unsuited in another 





where the forecast accuracy required is more stringent. 
Since any forecasting system selected for use must be sat- 
isfactorily adaptable to a wide range of demand patterns 
Tt 1S of interest to examine a few Of Eheeshore- tomer. 
casting models which are currently in vogue. 

This thesis investigates the types of time series for 
which various forecast models are appropriate and the de- 
fae tO which their forecast performance is decraded by 
Gmanges in the forecast series generation model. the re- 
sults of this investigation should suggest which model or 
models tend to be most adaptive in the sense that satis- 
mieeOory rorecasts are consistently made for the particular 


series forecast in the study. It is realized that fore- 


GcCeeE tae tier. 15° Si 
somewhat subjective. Also, the results obtained will nec- 
essarily be highly dependent on the series upon which 
forecasts are based, and the series used in this study may 
MOtebe representative of the many demand or failure pat- 
terns which must be forecast in practice. One must also 
remember that the optimality (minimum variance unbiased- 
ness) of even the least versatile forecast model may be 
demonstrated. As Bossons [Ref. 13] has concluded: 

(a) if it can be shown that the model corresponds 
mona linear transformation of the stochastic process as- 
sumed to generate the time series to be forecast by the 


medael, and 


io 





(b) aif efficient estimates can be derived for the 
parameters of the stochastic model and thus also of the rule 
for “adapting” the forecasts, them the jopeimalin ao sans 
rule can be demonstrated. 

The decision to trade this possibly restricted optimality 
for versatility can only be made in the environment where 
the model is to be ultimately used. It should also be 
moted that the measure of optimality associated with the 
EWMA models differs from that used in the least-squares 
meaclS wand £or this reason a brief drseussion @fetne dift- 
ijemence 15 needed. The EWMA models use the method of 
mrscounted least squares (D.L.S.). An excellent discussion 
DY Gilchrist of this and other discounting methods is con- 
foetee ii Rereremer 55. mis mous feeatten of «ne meciva OF 
moments, least-squares and maximum likelihood to incorporate 
frscounting may offer a fertile area for future investiga- 
tion in which the modified methods are compared to the 
Mmeteicional procedures. He argues that the discounted 
estimators have more robust properties than the standard 
methods. 

The method of discounted least squares is normally used 


with models of the general form 


Won = 2 GX 


: t=0,1,... 


foe eee + €.; 
where the tth observation is expressed as a function of all 
Mrevious observations, a parameter 6, and time t. The es- 
miinaces Of 6 are chosen to minimize the discounted sum of 


Squared errors 


it 





t 

q Z 
d Nee ea 
1=0 


where W, TS e Visiia tly, Of eiic aso, in pane In using this 
OMT Ont Wes a weighted average results which gives maximum 
welgnt to the most recent data: ~Jihe estimators 76 uc, 
Updated by simple recursive relations 4s ycacn new obsess. 
fion 1S taken. ~The comparisons made in this investivearien 
mene based Only om the mean Squared error of  nonecas tia. 
fwer, and no discounting was involved. It should be made 
elear that forecast performance has been measured objec- 
Mibely without regard to the type of optimality whach each 
ma@cie seeks to obtain. There 15 no attempt inthis thesis 
moe xtend Conclusions beyond such inherent characteriseses. 
However, it 1s hoped that subsequently, when operational 
mimesseries data must be forecast using a model, the com- 
mearison methodology expounded here will aid in the selection 


mmmcie ‘best’ model for that data. 
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Ime: 


SHORT-TERM FORECASTING MODELS 


A. LEAST=SQUARES ESTIMATION MODELS 


This classical predictionemethodiina Ss cvceed lee ce 


gression analysis, by considering a functional relations. 


between the observed values of the random process and an 


maependent or control variable.) Ine Generalhine asi 


pothesis is widely known and therefore will not receive 


move than a brief statement in this section. An excellent 


@rocussion of the conditions under which this approach is 


Most appropriate may be found in Reference 1. 


Zeliiast Ref. I] and Coventry |[Ref.Z) Rave imvestuodeed 


the advantages 
end ave snown 


tial smoothing 


of maximum likelihood estimation procedures 


7THat ie 2 - 4 a Sd ~ tee . * 
Chat LueSe MeETNOGs WL See Ge ee Oe 
a 


methods for both the constant mean cascmaud 


the linear model, where the forecast errors are assumed to 


Pemmormally distributed in both cases. 
@emaucted for non-normal, or auto-correlated series in which 


the maximum likelihood assumptions are not appropriate. 


No comparisons were 


relative robustness of the least squares method for various 


Series generation model specifications is one of the objec- 


meves, Of this iamvestigation. tlhe simple regression model 


meee orprovides a standard reference point from which the per- 


formance of exponentially weighted forecast models may be 


measured. 


1s: 


The 





i ip Simple Least-Squares FOTRe Gas caine 


a. oeries Generation Megel 
The process observations are assumed to be a 
linear function of time, the independent variable. The 


model may be written 


De ee 


, (A-1) 


ic 
where ie is the random process observation. taken atacame 
Xo and c. 1s the random component contained in that obser- 


vation. It is assumed that E[¢,] = 0 and Var(€ : 


== "9 = st Om 


- 
Meet. FOr this investigation By is taken to be zero in 

the generation model, and ali observations are relative to 
fmat level. 

Consideration of the generation model reveals 
that forecast errors will be composed of two components, 
errors of parameter estimation and the random variation from 
@aescruc linear model, Equation (A-1). As the number of ob- 
BPe@vations increases, it may be observed that the parameter 
estimates will exhibit smaller variance until the forecast 
Eefror is almost entirely composed of the random variation 
mimerent in the process. 

Dae aGaille Gen es tila imkom 


nie eas tus@ Uae secs © late son: 8, ii the ezemen 


mpeercept form based on observations YprVorr eon Se ceinc ma 


by 


nh 
» 
See 
B 5 c= 3 : (CA) 
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This form is used since all series Gmthas comp. 1s ome ain 
ae Re omiG tele o rhs, Xo = 0, Le = 0. The reader unfamiliar with 
the development of this estimator is referred to References 
l] and 2. It may be observed that Equation (A-2) above is 
also the maximum likelihood estimator of 8 4 Wien ] GaSe bla 
ther assumed that e«, has a normal distribution. The varzi- 


t 


mmee Of the estimated valle of Ge preeescs Ps oivenmo, 


2 
ae 


A 7 , 
VAR(Y,) CO. ; 
_Yy) 2 
F O4-% 
i=] 


& 


where oe 1s the (constant) variance of the random component. 
lilcm Ore cast Medel 
After parameter estimation using past observa- 
tions through time Xo. the forecast value of the random 


memes at time xX, 1s given by 


aan (Aes) 


mbthough, ads noted in Reference 1, the regression line must 
mee De extrapolated too far beyond the range of X, values 
mars method is well suited for one-step-ahead prediction. 
iimeract, it may be shown [Ref. 1] that Equation (A-2Z) is 
the zero intercept minimum variance unbiased linear estima- 
bor for Bo. 
Z. Modified Least~Squares Estimation 
a. Consequences of Autocorrelated Disturbances 
One of the crucial assumptions when dealing 


meth keast~squares estimation models is the serial independence 


iS 





of the disturbance term which is implied in Elec) |) = 6-0 

and gives ies vara = 0 for all s7OkepAutoe@orre lated. 
turbances arise frequently in the estimatponwotwen oa em. 
ships from time series data, and 1t will be Seemethaeeaimoce 
alt the serxes used in this comparison soto poe wd]  emocdeus: 
have significant autocorrelation. Some mention of the main 
monsequences of autocorrelated disturbances 15  eneretorcam 
order. In the presence of such disturbances, the estimates 
OF: By and 8, obtained by simple least~squares estimation re- 
Main unbiased, but the variances of the estimator may be 
mamec. his suggests the possibility of modifying the pro- 
manure to reduce the variance. Further, if the usual least- 


Saduares methods are applied, -an underestimate of these 


tl) 
(fy 


am as + Wie ee aac Tec. oleae ue tae. CS 
b. Series Generation Model 
The same linear model will be assumed here as 


before in Equation (A-1) ie = By tr BX, + €. except now 1 


tc 
Will be assumed that the disturbances or shocks are no 
longer independent random variables. Instead, a first- 


order autoregressive model is used which is given by 


ee) ee (A-4) 


where 16.3 has mean zero, variance O‘s anid. 26 GONCOv 4 riences 
ihoecive a better basis for comparison of the maximum likeli- 
hood or least+squares model with the modified model, the 
aie normal variates will be used te generate the sequence 
uS, in Equation (A-4) above as were used to generate the 


sequence oe iLiges eropeletan engin i=l) 
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Fa 


c. The Modified Forecast Model 


TO. pire di Cts for aseivenmalue se ts. ine 


eta 


conditional expected value of Equation (A-1) may be taken, 


(card 


giving 
ee ee er = 8, re BX + Eley lop eee 


= By + Bota * P€t- 
bere the result involves the conditional expectation of 
Eq@ation (A-4) also. Substituting the value of Ey ieROn) 


Equation (A-4) gives, after rearrangement, 
Fea aie; paar oe, | = B, (1-e) 4 85 (X, 447 PX>) + pY,. 


Shas Can be rewritten as 


=a. a, t 7% “ fe 3) ‘ Q f 

Y — 3 = Ms Senn fa a nm 

BA ee” O'e! G@aae:-s. Fad Dao Oy Dis ane Oy es 
cc reek ee ae c a . et tke ‘ 


ieeoe is known, Equation (A-1) may then be written 


ie OY 


t B, (1-9) + B,(X, eX, 4) + 9,- (A-5) 


t-1~ 
imieese transformation satisfies in full the assumptions of the 
fio le lanear model, and permits the direct application of 
least squares to the transformed variables (Y,-e¥,_4) and 
(X,-eX, 4) vaeldimgsthe bese dinear predacters an) temp cue 
Mmnecar predictor of (Yo 4p 7 OYE) 1s B, (1-6) + 8 (X,,,-eX,) 
where 8 and 8, are the least-squares estimators of the 
meeameters in Equation (A-5). This is equivalent to saying 


ferac the best linear predictor of Y eCondTtirondl sommes t 


eae 
observations, is 8, (1-9) t B 5 (X41 70%) + Oe, which may be 


mretttcn more clearly as 


ray Aw 


wep? 65 %441 * 0 ice reese (A-6) 


ie, 





Analysis of this form of the predictor provides some in- 
Sight and permits comparison with the unmodified form of 
the model. By incorporating the available knowledge of 
the autoregressive structure of the process autc mmmiiome aed 
mo the estimate of Yea: This term 1S the product ven soeana 
mae estimated disturbance (actually tem toreease cr ro ween 
the previous period. 

For a further discussion of the modified model 
and the effect of autocorrelation on the linear model, 
Chapter 7 of Reference 12 is recommended. 


B. THE SIMPLE EXPONENTIALLY WEIGHTED MOVING AVERAGE FORE- 
CAST MODEL 


i lmecenated Movingmiverace | UMegier mocesscs 


oe, ee = 
ECS Carlee © 9. 


- os ae a 7 Ss perry + were eb O° 2. te Aan halt 
Wkevasi weebaavuavarce 4 Stee eee ar Ria one aes 


mt) 
1 


&) 


meat the more recent observations of a process represent 
that process better than older data, EWMA methods which give 
larger weight to the more recent data in constructing and 
Beamgasting the model have been developed. It is intuitively 
miear that such discounting of older cata is not applicaple 
meen a Stationary process is observed, since even the oldest 
@bservations are as representative of the process as the 
Mest recent. 

SeOchastiG processes Of ENC Lype fom Witch En. 
forecasts are appropriate have been described by Box and 
Jenkins [Ref. 3] as integrated moving average processes. 
These processes act as though no fixed mean exists, but do 


exhibit homogeneity in the sense that, apart from local 
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level and trend, one part of the series behaves much like 
any other part. To clarify the déscriptionsomem pro- 
cesses three equivalent forms of the model may be formulated 
Ret .9eS)|4 

a. The difference equation form may be written 


ce = (1-8B)e, eee 


where V is the difference operator and B is the backwards 
eeracor. Ihe model may also be written usine these dein 


@mons as 
(Po 
bs The random shock form tollows {from the diticrene- 


ewaleat1on £Lorm by usc of recursive substitution for the older 


ese i viet. 1. O1io , 
Y, = a Eat e (B-2) 


where ye Ne 
es the inverted form follows, writines seeursmveis, 


im terms of the observations rather than the random shocks, 


Y, = Y, oe 


t E 


where 


mem which form, the model can easily be written in recur- 


sive form 


<> 
| 
Q 
<< 
+ 
WD 
wr 


_ = en 
irl cs fe oF 


eg 





This 1S recognizable as the recursion teormula eonmencmco. 
ponentially weighted moving @veragemeelt follows seein 
EWMA forecasts should be appropriate for IMA processes. A 
demonstration that this is true is Confarned ineseet sonmomoe 
The form of Equation (B-2) iS Most leonVventent wren scene ae ume 
IMA series, while the form of Equation (B-3) is most often 
used for forecasting. 
jo bhewseries Gene rariong ode! 
ihe wspecitic ENMAwgeme na tame snOde lh sitcedarl Tl eipis 


Study can be treated as a simple random walk process, one 


rime 15 reasonably stable with no trends. The model is 
given by 
= VY S 
Vom) Wate 2 
rp AN 
e 
“ia et 


where Y, is the observed value, a is the true level of the 
jmmocessS at time t, i is a slight random change from the 


Pieuer process level, and ¢«, is a random shock or supérim- 


i 


posed error. and Y, are uncorrelated random variables 


=f 
Wie zero mean and constant variances V(e,) and Viv) respec. 
mevely. It will be shown in section B.5 that the EWMA fore- 
cast model supplies the optimal linear least-squares predictor 
Pmeenis generating model. <A further result, provided 0<a<l, 
is that any generating process for which the EWMA is optimal 
manebe represented by the generating model above in Equation 
f[=4) even though this model may not necessarily describe 


the true generating process. It must, however, describe the 


eeereernal behavior Of the Erue Generating process accurarery 
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or else the EWMA would not then be optimal. Stated another 
way, if a process cannot be represented by Equation (B-4) 
then the EWMA forecast cannot be an optimal forecast rule 
Pore that semes. 


3. Optimal Properties of Exponentially Weighted Fore- 
Gass 


It has been suggested intuitively am the preceeding 
discussion of IMA processes that the EWMA recursion rela- 
mom describes the process exactly. Following the approden 
oe Muth j{Ref. 4], it can be shown that for an IMA process 
mme EWMA equals the conditional expected value of the pro- 
cess. 

The EWMA forecast results from a model of expecta- 
miems Which are adapted to the most recent information con- 
Sem@aine the process. Let i GBep Ges Cit sem ated tO ee cmemennne 
series which cannot be explained by systematic factors such 
Meese aSOns Or trends in the average. Let Y, represent the 
Memeceast, Or COnditional expectation of be which is made at 
time t-1l on the basis of available information at that time. 
Assume that the forecast is changed from one pcriod to the 
fiers DY an amount proportional to the latest observed error. 
iis implies that a permanent component exists in every ob- 
Semed error and that the level of the process subsequently 


ise rects this component: 


wn 


Nee a a(Y,_1°Y,_4) 0<a<l (eS) 


fairs in turn yields the EWMA formula: 
ae = aL LR 2 


ai 





Since B = l-a, the weights correspondinowcou revi olcm ae 
of Y, do not introduce any systematiewbapace 

Assume now that the observed value of the process 
Ganebe written as a linear funetion@oet thesindepencdcneenan. 


jem shocks: 


Y. = 2, ao eee (B-7) 


where the shocks are i.i.d. with mean zero and variance o?. 
If the parameters W Wich Ciaracte ia Zeusuine ssgaIndon 

mmocess are known, the expected value of Y, may be easilv 

menmind., If it 1s desired to do so one period in advance of 


mime t when €, 1S as yet unknown, the conditional expected 


C 
value of Y, given the past values aaa Te? en 5 eee 
Hees to yicic 

n co 

Yee =e alia ex 5 C uyekla= be Wi C4: (B-8) 


To relate the regression function above to the EWMA 
eeeomession, Equation (B-8) must be written as follows in 
memms Of the observations, where the values of the coeffi- 


ements Ue must be determined. 
on = y One oe = 4 (B=3)) 


SUbS ti tLuting ner aes with the random shock form 


mie rearranging terms results in: 


Y = > Ue 2S y W. _s_: = Voorn 
it j=1 j i) = tzi- | (|e Saiaete galt 
60 i-1 (B-10) 
+ ». Wa ye ie Wee Ce 
i=2 a Tok J 1-J t-1 





A relationship between the parameters (W. ) associated 
with the unobserved shocks and the Cocemuwe vemes Ca) associated 
with the past observations of the process iy mew ocptaincashb,  com- 


Daring coefficients of their respecemvewesgme cmos 


Wy = vU 


Wi= Uv. + eee es 2s 


To demonstrate that the EWMA forecast evolves from 
mee above process, the weights Ds = coe ] = 132,539 et bom 
mieninverted form are substituted into the above expression. 


This results in the system: 


Wy = a 
1) 
Stel 
Wo a oe Pt ” Be 154 nN, Oe 
j=l 
Mmemean be seen from the above that VE eee omera ll 1 > Se 


Writing Y, in the random shock form and substituting 


a = W. results in a form comparable to Equation (B-2) 


eco 
Y, =" OE » fi + €+° 
1=1 


Consider ronlor this wexmpress1On reveals tnat tre 
eimeick associated with each time period has a weight of unity, 
but previous shock weights are constant with a weight between 
zero and one. This demonstrates that part of the random 
maoek Experienced in a period has a™permanent effect, but 
the rest of the shock affects the process only during the 


Grrent period. 


Zo 





The foregoing assumed that forecasts were always 
for one period ahead only, but it Can Bewshowimemat enem bese 
forecasts for all future periods arewtite ssamc incre 


may be found in [Ref. 4] and is a generalization of the above 
approach where YET = 29 Wear CpG 
ieperzveds ahead. The unique solut@enme fomeemewcocttuercne> 


results in Ur , = o a k = 0,1,2,... independent onan. 


represents, the frencease 


meserted. The reason for this result 7s thar all pre: 
emoeks are weighted equally and the forecasts then only es- 
Eomate the permanent component of the shocks. 

Muth [Ref. 4] also shows that the EWMA forecast 
mre 2S appropriate if the permanent and transitory com- 


Memients are independent rather than perfectly correlated 


ge geese TH 


” . i. 
&5 ae an , * 
wt eh wwe we ee ok eb = - | en an me 


Gace however is constrained to be a function of a chara@eter- 
meme root of a system of difference equations. 
4. The Forecast Model as an IMA Process Generator 
The fam@liar EWMA forecast model is identical to the 
[MA process in Equation (B-3) Fey = Yea] = a Y, — (1-a)Y,; 


momen may be rewritten in the random shock or forecast error 


meme Of Equation (B-2) by substitution of the error Ee, = 


Nn 


Y; . Y,- This yields 


= + 
Yea] Le O Ey: 
Suceessive substitutions for the oldest estimate in terms of 


the prior estimate plus the permanent component of the ran- 


dem shock yields a form equivalent to Equation (B-2) 
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aw 


Sion = Y, + @ 29 €,> and here Yo = 0 Ss GOs ciplen clang om 
which the process is measured. The former Equation (2-5 
is such that a series of autocorrelated forccasts may be 
easily generated. Following Muth s aitermoareta: lone) coe 
Ehis generation method merely adds the permancmercommponcnwmcn 
the random shock to the current process estimate to yield the 
next period estimate. 

Simigce the Wext period has an associated erence ace 


feeor, that error 1s then added to produce the desired cob- 


Servation: 


which by substitution of Equation (B-2) is in a form suit- 


 . . ao a ees 
aweee LUT owe thi VI Few ce 


Ton SeTRMes george eien cumme: . This 
model, having no fixed mean, is free to drift in a random 


meee, it may be observed that when €, 1s reduced to zero, 


t 
the model no longer experiences shocks and becomes deter- 
Mastic at the last ‘ for which Ee. ? Op the vasympremie 
fmerance of the generated séries may be determined by ob- 
serving from Equation (B-2) with t>» that E[Y] = E[€] = 0 


and 


a * Ely?) © Biv]? pigie 2, py y,_, | = 54 0%. (B-12) 
1= 


In Peneraeineeries auuoeertelated Series, themeon. 
Stant ao controls both the amount o# correlation which exists 
and the series variance. When o=l, the series is perfectly 


correlated with the random series and has variance o?. 
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>. » Parameter Estimat tone) neceaune> 
To develop optimal parameters™@tor a Speci eres miltcsr 


eonsider a strictly stationary Sstochastieuproce = mae 


4 = = 2 = - 
E(Y,] = 0, VAR[Y,] = 07, COV[Y,,Y,,,] = 9,07. 


me the EWMA model is used for forecasts, then ene. meamesquanee 


eeor Of prediction 1S by definition: 


es a 2 
Me Ser. ELY, Y,] 
Eeeanding this expression, 
Mes. = E{Y¢] : 2E[Y,Y,] 2 Eee (B= 
where Eee =a ae (B-14) 


AN 


SU Bsr iae Ue 10 paie@ ee in the second term above gives 


“aw 


=talieenowl = = 2k) (e uo du eo 


mG 
= -20 2 eer | omniees 


fepanding the third term in Equation (B-13) and substituting 


OT 1 yields 
1 
aE |) 8 ieee 
1=0 


Eeepanding the expression formaily results in 


2 
+ B72 Y t see = a7W (B-16) 


2 
i Lis + See t-2 


tou 
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emcee eaanolt Bey + eto (B-17) 


t-1" He? 


Soeiiee ie iS a strictly stationary process, Wma) salsompe 


iets tec Eee sage) Ore B*Y, 2 eerie INecarmecnaesloyy 


this becomes 


W = EAs ea + BY + B°Y Ree ele 


poe tes 
which may now be expanded. Proceeding formally, this pro- 


cedure results in 


= 2 a 2 aye 2 
W BLY? ] + 2ETY,B(Y,_,+8Y,_5+8 Y,23 + )] + BSW 


which may be written more briefly as 


co a 
1 2 
ee eee Y. Y. . I+ W 
Dh ete ee) oe 
i=l 
Cc 
=r tec. Ff cm 7 hed wae +e 
= alt ; 
1=1 


Here u is defined as the sum of the first two terms. Solv- 





ame for W, this becomes W = ae Again substituting W into 
Equation (B-16) results in 
2 = au . 
a“ W eee (B-18) 


womeining Equation (B-14), Equation (B-15), and Equation 


feo) in Equation (8-13) yields 


. Ree . Zao: \ ded ey 
M.S.E. = 5 aan 8 Os (B-D ) 
i=l 


ee) 








-O 


meh is the mean squared error of one-step-ahead predietion 
aeea function of the smoothing constant and the autocorrela- 
[on of the series. This 18 a result obtained by Cox, pe 415, 


fer. 9. For a Markov series with exponential autocorrelation 


Zh 





oak 
Eo » k > 0 


where k is the lag between observations, the mean squared 


error for one-period ahead forecastsmpcesne- 


a2 Coal) 
M.S.E. cam (1-Bo) (1+8) (B= 209) 


the MSE is minimized for a given po by an EWMA predictor 


which has parameters 





_ lee =f 302) ae 
Pont Sie coe en nse 1) 
(es 2) 
1 DCO) 


These results are obtained by equating to zero the derivative 
Piewegquation (B-20). The corresponding mean squared error of 
prediction for the EWMA with optimal parameters is obtained 


inom Equation (B-20) by substitution 


2 a 
Mi, See =e cone Cee oe ee 
(se) 
oo) 206 een) 


Ppealiysis of this result discloses that when o > 1/3 1f€ is 
Optimal to predict the observed series values using a larger 
feerue Since there is sufficient correlation between suc=- 
Besoive Observations to make this procedure advantageous. 
Neen op < 1/3 the EWMA should attempt to predict only the 
Mean Value of the process since so much uncertainty exists 
Sencerning the next observation. When the optimal a equals 


Ze10, the MSE of prediction equals the variance of the time 


ZS 





series. When p=a=1 perfect correlations pe ynittoeo ee tomeom 
Casts wand the MS rem Sezer 

The preceding results are obtained by Cox (Ret. 5) 
who also developed tables showing the relationships between 


Oo, and the MSE/o* ratio. It is interesting to note 


Soni? 
Gimat aS one predicts more thamoone step ahead, sane critical 
Veomueael Owsnereases. One conclusion drawn from Cox's 
tables is that MSE is not sensitive to the choice of a 
smoothing constant, and although the optimal a may be zero, 
ieosts little to use a = 0,1 as insurance against a possi- 
Bites change in the mean level of the process. This insensi- 
Eveness probably accounts for the success of the exponential 
smoothing model proposed by Brown [Ref. 6] for which he uses 
Det ov east aape eg Os 2 tet tae: 
Gael tor general use. 

Mimaliewnat 1 Veeanp roa chieseomont ima l-spancane pemgade at 
vation for the EWMA forecast model used by Harrison [Ref. 7] 
may be taken by considering the generating model in Equation 
(ery. Recalling that the one step ahead forecast error 


n 


en = Y. - B, = Y, - Yy> and Sanat fimemsoreecast model “rs 


wn 


os = ti + ae,, a difference equation Mayube Written EoORex, 


Paeiss the one step ahead forecast error 


e = ice aS ac (Baw) 


t+1 t+1 t ~ Yer: 


Mmemethe expectation of the product of Equation (B-22) with 
both Ce 4d and Ce, yields the variance and first covariance 


respectively of the one-step-ahead forecast errors 
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= 
i 


(1-0) C + (+0) Vite) ee) (B-23) 


CD 
! 


(l-a)V - V(e). 
solving these two equations for V yields 


Z00V Ce) t. Vi 


asa . 


(Bo2@) 


Differentiating this with respect to a gives the minimum 


variance parameter 


6 
= ee eet where R = rey . (BeZoe 


Substituting for a in Equation (B-24) it is found that the 


a Vie : : 
minimum variance is V = Ag and tne "cOVaT Tl alG@comwi a0 ea 





EeenOr COVarlances may easily be shown to be zero by taking 
miemexpectation of the product of Equation (B-22) with ae 


s . ce 
Sg if Bab iesc +h 
—~- — = = =. = ‘<r eae Tk 


—_ w ~~ 


meen tc > 2. s+xll cowarisne’s Gre zens; 
the predictor is optimal. Although this approach was used 
eeedarrison [Ref. 7], he then recommended that because of 
Miewtisual Shortage of data, general robustness, and pre- 
Seton, tor short-term forecasting the optimal parameter 
eaould be derived from a simulation of the predictor on the 
Meretinal series data. This has also been the suggestion of 
Cox, Brown and others. It appears that even though the op- 
timal parameters may be determined for particular series on 
a theoretical basis, it is faster and possibly about as sat- 
/mmaectory in terms of forecast results, to determine the 
feeeameters empirically. The insensitiveness of the simpie 
EWMA model to the parameter value chosen has made parameter 
fewcetion an area of rapidly diminishing @eturn for tie cr. 


fort expended. 
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oF COX'S MODIFIED EXPONENTIALLY WEIGHTED MOVING AVERAGE 
FORECAST SNOUEL 


1. series Generation Model fonpthewexne mene ne Wier 
GCOrrelati on bunernen 


Cox [Ref. 5] has shown, as noted in Section B.4, 
wat the exponentially weighted movamge average 1S eaneoptiman 
imrecast method for time series having am aueocornelaeron 
@ectirticient with lag k of the form p(k) = BS A recursion 
jmematron which 1s identical to the relation for exponential 


smoothing and which generates such a time series is shown 


m@yenaylor {Ref. 8]. This recursion relation 1s given by 


ie 
O 


Cis 


Yy = BY. 4 it (1-8)e, 


4 toe ae ae ee 2 . nose a -. Sune seed 
Te MUCUat Ly PNG eeVit Vat eC S UCU LS RS 


where ic.} 
L 


fu 


mean and variance On. 
ihe method used 9n thas investi gatienve tony poauec 
mm@emexponential autocorrelation function requires that the 


Ey be uniform random numbers in the interval [-A,A]. This 


Sier1ce of Ey results in exponentially autocorrelated vari- 


ates Yy which have zero mean and variance equal to 


— 


De ome ie 2 
y 1+B %¢ =e 





0 


where a, the smoothing constant, equals 1-8. That the re- 
€ursion relation above gives the desired result may be seen 

by using recursive substitution so that Y, = a ve ple 
Guerin terms of the random variable alone 


ee 
ie- 3 Be coe tens oe 
t j= 7 0 


oA 





The mean of the generated time series follows immediately 


since E[Y] = E[e] O and the variance is 


o 2 


. E[Y*] = EMI? = aie 


Squaring the recursion relation and taking expected value 


Pepe? 2 2 2 . co 
gives oe B E[Y+ 4] if 2aBE[e Y, 4] aac! Ele; ] which gives, 
Since €, and Y,., are independent wich mean zero, themmecueer 


(1-8*)o) =) Goa 


Ol wuete - : : 
Therefore, o2 = or. While 15 ecomivalent) Lomrnem cm Tame 


oe ee 
Eeoression above. When, as in this investigation, the ¢« 





Ct 


are uniformly distributed on the range [-A,A] the variance 
becomes 


Ay 2 me 
Z 5(1*B} 


Cane 
A 
+ 


TO{ 
Fito 


a — 
wt y il 
fmemauctocorrelation for two numbers which are k observations 


apart in the time series is 


ES) = Ti ee leet oe eee pee 


mien implies that the autocorrelation coefficient is 

p(k) = 2U) - gX which is the desired result. This result 
1s Bieained by making a transformation on the summations in 
ie product ere whiclhy makes use of the Stationarity of 


tme series Ey and thenetakimngethemsexpeeted value Or EnC=p nen 


ane t a while both are expressed in terms of the random 
Sm@ocks. The transformation referred to above is 
t+k+]1 : t-] i+k 
= j aye ak ta Kee J 
1th =o p> p cee, Tae © 5° 2b erk- +k) 


2 





Tipe. 
+ apt Ke | =a cr as Br ey 5 “ ape) 
j= 0 


which has the same expectation as eXE Ly 
k 


fale Therefore, 


ELY, ee = 8 Ee = Bo? = 6( Kk) from which the pester 


follows immediately. 
i.» Wiener seep tind! Uineaueincdmenen 

Cox [Ref. 5], after developing the optimal. smooth= 
ing parameters for exponentially correlated (P} = ay time 
Femices which are shown in Section B.4, sought to improve the 
model so that it did not lag behind when used to forecast 
swies containing an increasing mean value. He made use 
Seewaener's optimal linear predictor for this same series 


fimten 1S given by: 


SauaN 


C-1) 
-s ee * h 
” ? . ee at 7 xy a qs = ~ Y “L leo on 
NeOBiCs) SOG. (ae Ce 


Ee 


where h is the number of periods ahead for which a forecast 
memaesired, and p is the autocorrelation coefficient of the 
memes to be forecast. The Wiener predictor has a mean 
emiace error of forecast which may be written 


ee 
M.S.E.y = (1-p 


Jor. 

The Wiener predictor, although shown optimal when 
all assumptions were met, had two properties which made it 
@mpectionable for practical use} First, the parameters 
and p are assumed known. This can be overcome if sufficient 
past observations are available for use in estimating » and 
©, since the mean squared error is asymptotically unaffected 


By the substitution of unbiased estimates for these parame- 


ters. The more serious objection to the predictor, Equation 


oS 





. 


(C-1) however, is that it becomes biased if the mean shifts, 
correspondingly increasing the mean square error of fore- 
Sasi. 
3. The Modified Form of the Model 
Cox extended Equation (Col Mibyecubs © een. Y, fon 
uw so that the predictor would follow shifts in the process 


Mean. Equation (C-1) then becomes 


ea eee 
Pee ae Chol) ie (GS) 


Semesubstituting for Yo it May be written 


A : h lee 
enact One) ner eS lm) orem (en 


iiepection of these two equations reveals that as o-0 the 

Mon vi hiuivation (C-3) A@pntruathnes tual of Tre wWaefer o1e- 
Meeeor, Equation (C-2), since Equation (C-4) collapses {fo 
Eoadeton (C-]1)}. Also note that when p # 0 the model Equa- 
mreme(C-3) is no longer an exponentially weighted moving 
average. It is instead a moving average in which the weights 
of past observations decrease exponentially, but in which 

the current observation receives a weight which is not a mem- 
ber of the same geometric series. The weights appearing in 
the expression for Y, in Equation (B-3) sum to one, as do the 
coefficients of Yy and i: isIE CUR Ase de orice eon heir con atta ii 
taining the desired average. Another observation concerning 
Equation (C-4) is that as the number of periods ahead for 


which we wish to forecast increase, the modified predictor 


tends to reduce to the simple EWMA form. 
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A Parameter Estimation 


The mean squared error of Equetiem| G->o)meomow 


by 
262(1-p") (1-874 go" : Boal 
Wes orale. oe a.) 62. CC (Co) 


which reduces to the mean squared error of the Wiener 

predictor Equation (C-2) when §=1l=h. The values selected 

for g@ and 8 in Equation (C-4) will necessarily reflect a 

compromise between the desire for a minimum mean square 

error and a desire for protection against a Change in mean 

Pmeecess value. As Cox has shown [Ref. 5] however, when the 

Pmueinal value of a 1s 0 there 1s insignificant change in 

mean squared forecast error for the EWMA when a is made 

Memecr ur to the range 9.1 or 0.15. 

D. tne HOLT-WiINTERS AND THEI L-WAGE. TWO-PARAMETER EXR@e 
NENTIALLY WEIGHTED MOVING AVERAGE (EWMA) LINEAR GROWTH 
FORECAST MODELS 
Holte Ref. 9) as further diseussed ine@Winteers ji her my 

pmeposed a forecasting model for time series exhibiting iin- 

ear growth which was a simple extension of the EWMA method 
already applied to time series with constant mean. Although 

Winters' development explained precisely how the method 

worked, he has been criticized by Theil and Wage [Ref. 11] 

amaeothers for failing to explicitly justify the method. 

[iieerationale for the criticism seems to be that Winters 

meted to formulate an explicit stochastic model as a basis 

fem the forecasting method. Instead, Winters used a com- 


meetely empirical method for selection of parameters. It 


ao 





must be observed, however, that Winters vtilivedesim meee 
of actual data from three dissimilar processes. His ap- 
proach is probably representative of those currently used 
when real data must be forecast. For real data, when the 
model is in fact unknown, Winters' approach implicitly as- 
sumes various underlying models and his choice of parameters 
which gave the least forecast variance is his implicit spec- 
f[meecation of the underlying model. For the purpose of pea. 
mavestigation the criticism raised by Theil and Wage is 
monmsidered valid, and their generating model will be used 
along with a discussion of their determination of optimal 
Darameters. It may be added that Harrison [Ref..7] has 
feeemlated yet another generating model for the Holt-Wainters 


Sie ae: 5 &- Sle ree a ae! el eet 
Pe EeuUrsetvvui Wihwdil Cg ee A) OL arakiresty 


pw! 


mildehas also derived optimal parameters. 
mee tiie LinéearwGrowtheservessGenerationeredel 
The Linear growth model proposed by Theil and Wage 


meet. 11| is given by 


Y, = Y + b (D-1) 


Mere E. 1S again a random shock or residual by which the ob- 


servation Y, differs from its mean value sa and the change 
Per ibuted to trend or the slope by is changed by a random 
amount Oy: The random variables Ey and 6, are assumed to 


Mave zero mean, constant variance and zero covarianees. 
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2. The Forecast Models 
a. the Holt-Winters Moder 


The Holt-Winters forecast model 15 )¢iyemepy 


“a 


F, = Y, + kb, (D- 2) 


where k = 1 for one-step-ahead forecasts. This is the orig- 


inal exponential smoothing model in which 


Ye = a Mig + B(Y, 4 = b, 4) (D- 3) 
and 
b, = q' OC - Loe + B'b, 4: (D-4) 


iiemtiarst parameter a in Equation (D-%3) 1s the smoothing con- 
meanc ©£or the process level. Note that Equation (D-3) as 
m@entical to (B-3) except for the addition of the slope te 


mienprevious process levei. Time second patahtcer a” ai 


4 


Eo@ation (D-4) is the smoothing constant for the exponentially 
emeothed slope estimate. Holt and Winters place no Constraints 
on the relation between a anda! as do Brown [Ref. 6] and 
teri and Wage [Ref. 11]. 
b. The Theil-Wage Model 
Theil and Wage have See ee Equadc Homes| Dew 
HMemmects available information and propose to replace die gwith 


“a 


coe ancra Ql aD (D-5) 


+? 
which they consider a more simultaneous, rather than a re- 
Cursive, approach. Taking Equation (D-4) and substituting 


mito (D-5) they obtain 


S7 








A 


ree re OO IP Be. a) 


<> 
i! 


t L 


nw 


1 1 
Ba'Y, + aY, + B88 Ca + b 


t-1? 


ma therefrore, solving for ie 


nN nN 


ae Bb. - 
Y= Geggm “a weeere te a eee (D-6) 


merch is of the same general form as Equation (D-3), but 
the smoothing and discount parameters are changed to obtain 
all the information contained in the observations. Note 
Maat when a' = 0, 68' = 1. Equation (D-6) becomes identical 
memeguation (D-3), because when  . qa! = 0, correspondingly, 
mee slope is constant and therefore makes no contribution. 
2) Earameter Estimation Procedures 
to) Ge MO ntme ices soc eu 

Ineyenpinredl parameter scleect ren mc Enodmmsca 
Meeervinters [Ref. 10] was a steepest ascent search for the 
Optimal parameters. While this may be appropriate for 
Mimmtical forecasts, it is recalled that the objective of 
mee COMPArison is finding a forecast technique suitable 
Memeroutine forecasts of many items.’ Clearly, a search is 
imappropriate for each of them. Instead, use will be made 
SeeWinters' findings concerning the best composite parameter 
Paeues obtained during his investigation. 

The evaluation method used [Ref. 10] to arrive 
meethne best composite values was to express the forecast 
error standard deviation for each parameter combination as 


a percentage above the minimum standard deviation achieved 


- 
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each product, and to add daeéresceuhnewtnrece products stom acm 
parameter combination. The best composite rating of 24% was 
menieved by parameter set ( )25eeeeieetoumc ge ce mocimean. 
eters will be used in this forecast Comparison with the 
meservation that they may not be the best parameters for 
moe particular series used here, As notéd above, however, 
Mer mass forecasts these parameters must suffice. The ro- 
Meotness or insensitivity of the model to various series 
should become apparent regardless of the parameters chosen. 
Although neither Holt nor Winters gaveva pro- 
mecaure for optimal parameter estimation, Harrison [Ref. 7] 
develops optimal parameters for a specific linear growth 


model 


r<| 
it 
ae 
+ 
o- 


for which Hoit's predictor gives the least mean squared 
meeor. Following Harrison's procedure, the difference equa- 


tion form of the Holt-Winters' Predictor given by 


ine Poe De 
ey Des a CI 
= i 
os ae 


may be written more compactly as 


Oe 








e =. ae) tbe eke (D- 7) 


te t coal ttl 
where 
a= Z = Or ae a! (D- 8) 
Dima (eao)) eae 
(Bao 
Pera ~ St+a 7 2%e * 4-1 * Veer ~ Ye * ¢eg- 
Expanding Equation (D-7) gives (D-10) 
Ste] 7 a es ese Co) 
1=0 
where 
Wy = @q Wy 1 by Wh > 
and where 
ee ' en — one yg 
1G a4 ae, call es? “3 ; “ oS 
When dy and 5 are elOOeS sOr stne equation 
a - az - b= QO 


mers in general true that 


mom Equation (D-10) and Equation (D-11) it follows that the 


@rror variance of forecasts is given by 
—& ee 2 Py 
V(e) = io [(A,W,)“V(e) + (AW,)“ V(6) + WE VCS) 1. 
= 


This variance error tends to a limit if |W, |< 1, which im- 
plies that |, | and | A, | are less than unity also. For Sta- 


Bality of the expression it follows that 
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ae 
at (a> > ini 
2 ale 
When a substitution is made for a and b the stability con- 


ditons become 


(ata)? 


t 
Sete 5 


(D-12) 
Wieiees eky  < tD (D-13) 


The optimal parameters must satisfy these conditions, and 
eeemee they will be determined as functions of the variances 


ome), V(y) and V(é) the parameters are further restricted by 


Oe es a) ee Gains) 


Blot thee py tes Te an taere yee FT Le apa -t-- 3 
Litadi Feil UpPALLiltatst pPabalbtuevwvwin Witt YUU VCWIilbatatee 


ma 


Sees Lip. tus 


imenin the subset of the stability region defined by 


(ara)? 


< q' < 
J ee Otel 


aur COS 
OG <save) 


iemdetermine the optimal parameters, Equation (D-7) can be 


mieetiplied by both e anGuac giving two equations which 


etal ee 
May be written 


(1-b“)S* = a(l+b)c, + bd, + d (D-15) 
2 — - - 
as” = b)c, dy 
where q = Se a a and Cc, are Gite Veda Gersancd wa 1 ica 


; : Sak : 2 
Meeeriance of the errors, €. Eliminating S from the equa-~ 


tion gives 
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(1b) [(1-b)* - a*}c, = (1-b“)d, + abd, + ad, (D-16) 


2 


it is shown in Appendix Gite, Reta sthae tie wcons tamecu ewe 
and V satisfy the stabiliey Conditions tor the rollowine sain 


fefined in such a way sels 


bV = V(e) = d., 
(Dea 

aV = (4-a)V(e) + VC(y) = “d, 

V = (6-4ata*+b)V(e) + (2-a) Vy) + V(8) = a 

d. =S0u fone jie oe 
feen tcnese values, the right hand side of Equation ()-16) 
Simplifies to 

2 2 a 
Viejo Dated s tea —_ 10: (= koe 


~~. cas in a j we 
a 


» ~ e 
Referr? Ver +r, Cmts ee AYN cs . “i Vy Ss we ae ee. eve 2 . ea 
PO 27.11 TYE ww ty ee eave Le Vv) Reda ~ 


oueti<cth. (D-G) dnd cubs t8 tu 
mmo fOr a and b in the above, making use of the stability 
Meeenictsens ine Equation (D-14), 1t is%seen that them@ecciri- 


oent of Cy inwequattonm( Dee 1S 


ao [4 -Aesg4 | > 0. 


mepece Equation (D-16) equals zero by Equation (D-18), it 


follows that Cc, = (Ponder nonmkguiaci one (0-415) and (P)—7 ) ie 


mollows that say, Sinee all other covariances Can smc Shiewm 


femoe zero by multiplying Equation (D-7) by e de seco 


t-i? 


meetOllows that the predictor is optimal when the parameters 


mata sty 
V(e) = (l-a)V 
V(y) = Cee ea 
V(8) = a! @V. 
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Here V is the minimum Ve@rianeeeoreercecast se) roT meine ep nop. 
lem remains, however, of estimating the variances of the 
~mandom components of the processomenaniisonm Succestsmtnicuise 
@e Serial Variation Curve analy sacmorethe Observcdsdatameun 
assess the suitability of the model for forecasting the data 
Mee tO Drovide an estimate of thesvarrances meceded teyscetean 
mie optimal parameters. By examining the first differences 
Seeitne data, Harrison [{Ref. 7, p. 833] states that the Serial 
feeeiation Curve of the first differences is expected to be a 


menaight line with gradient V(6) for i>Z, or 


2 


3) rear) Oa AN (Ce) easy eect U0 V Cop eae Z 


1! 


6V(e) + 2V(y) + V(s6) , i=l. 


aees ot to stats, hewewer, tnat for precticai applications, 
mas method for determining the variances has a large error, 
meeconcludes here, as before in his derivation of parameters 
for the simple EWMA model, that the optimal parameters are 
feean best determined by simulation (empirically) using the 
@erval data. For purposes of this comparison, then, the 
Memmameter set recommended by Winters is still retained. 
b. The Theil-Wage Model 
To determine the adaptation parameters a and a! 


which minimize the mean square forecast error the forecast 


Senor must first be expressed as 


wn 


a . +b, - Y, = Y, +b, - (Y,_,*b 


t t t t eel Oe eee 
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where the value of ne in Equation )-=1) 1s substi tucedmamnc 


Equation (D-Z). This may besvriteen in more sconer=caneea. 
cL Oilonas 

Ie A, + By ee. Oy (DD 
where 

At = Y ee b ae 


Moninsure that the notation 1S Clear, recall that the fore- 
A A 
east of ue 1s F. = Yy it by Whiehweam. 1) ce sconsitae redudc cal 


estimator of Yy expressed as 


fy Soe i RO 
ca tmamentenieswscsi ae ae 


Reem Equation (D-19) it can be seen that the forecast error 
meene Sum of three terms: 

the sampiing error eg Gumene Mean DrOCCcoommema Cae 2t Gite 
ae, 

meme Sampling error (B,) of the slope change at time t-l, 

and a disturbance combination associated with the tth period. 
Beang the forecast model Equation (D-3) and Equation (D-4), 
the sampling errors can be eliminated successively from 


Equation (D-19) and it can then be written as 


Y,-Y¥,- 0 


t aoa 


ieee Ores Pets oo eee 


Further rearrangement reveals that A, can be written as 
= = Clo) (ae op + OE, - (1-a)s,. (D-20) 


The same procedure permits Be BOC Wiese Gel) 


By == raatA, 4+Cl-aa')B, ,taa'te,-Cl-aa')s,. (D-21) 
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Finally these results may bee xpress comin ycetor soma. 


At ae [“t 
= Pp +Q (D- 22) 
Be BeeyJ LS - | 
where 
B B ae 8 = aa' 
p = », Qe ; ° 
6 on G9 =79' Gy =" ewe 


Analysis of the above reflects that an optimal a and 6 imply 


aueoptimal a' also. By successive elimination of the vec- 
Zor 

el 

ee 


mi Equation (D-10) that equation then may be written 


A A E 
it t-n ee t-k J 
Sipe : f - pkg | | (D2 
Ds aeen k=0 Sek 


Mem & and a' are positive (the latent roots of P are within 
Mmememunit Circle), the first term on the right of Equation 
(D-23) converges to zero when n>~™. Combining this equation 


fen Equation (D-19) the forecast error may be written 


= 7 ©t-k (D-24) 
e, = [1 1] 7 pXq Reps © Soc 
k=0 a 
Om expanding and taking the expectation formally the mean 


maimare error 1s seen to be 
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Gell 1] (QDQ'+PQDQ'P'+P2QDQ'P' 74+ ++) [7] : we lc ees 


6 
where 
of 0 
D = 
Z 
0 Os 


Momsimplify the MSE expression, @the Lerm in parenthesis ma, 
2 

Be, prouped as 5S = QDQ'+PQDQ'P'+P“QDQ'P!“+-°= andigi) Se aa 

EenQ'P' + P*QDQ'P'+-°> may be subtracted from both sides of 


Eouiation (D-25) giving 
Se oe oO aes (Zap 
Mies result can then be regarded as a set of linéar equations 


in the three elements Say? Si? S54 of S since it is seen 


Maat S iS symmetric. Equation (D-26}) can then be written 


momexplicit form as goliows 


Siq Si B : Sq S19 B -6 
t 


Peeci after rearrangement, has the solution 


eT (2-06) 0 2876 7 
E 1 mae ; ee 
ie GeCla2aaon 8 0 (20(1+8)-6)8 B(a(1+8) - 6) 
S13 (1+B8)0? 2(a7-20+0)8 o%(1+8)+268 
22 2 ee “| 
Ce ee 
ado + Beta? (S27) 
Q*o2 Ee 0'*0% 
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Returning to Equation (D=26) it is sme@ted that Semustebe pre 
multiplied by [11] and postemGhtip eas bs i ice 
gests the form Sy. + 28,5 + Sj, so Equation (52 )eae 
mpaomultiplied by [121]. Uhewpacdwetwo ne niseyectonmeeneme ne 
Seo Matrix on the right Si¢detor eat none 7 7 je ccule sien 
m0 20 %1+6]. 


Combining this wath eoquatron (N-26) thesmmean 


eomare prediction error is found to be 


= 2 2 2 2 (4c 26) 
a ee er aren 


2 (1+8) i‘ 2 te (lee) etaet2o-) ; 
Ione ln eon) Ce ao(2(1tB)-6 (D- 28) 
where 
Cec oe ea) 


Maeeratio of the slope change variance to the additive 

anor term variance. The nature of the random processes 
fomlelly encountered suggests that g is often a small num- 
mer, Now that the MSE has been obtained in fairly simple 
form, the optimal value of 6 may be found by taking the 
ferivative of Equation (D-28) with respect to 6 and equating 
Bieemumerator to zero. Solving the resulting quadratic 
Semation in 9, the optimal 6 value may be written 


~~ 


Q 


h* (1+8) (D-30) 
where 


-1/8 g? + 49(1+1/16g2)% - (D- 31) 


2 
2 


Equation (D-39) gives the value of 6 which will minimize the 


fern Square forecast Error, given a specific @. Recalling 
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that 6=aa' it is seen that somes ascecrcasing IMmnear tuner ron 
of a. As a matter of convenience it has been found easier to 
work with h than with ¢ som@solwamesboua tron CUS ol) ponmecunie = 


o 


Sults in 

6+ = Ae eels (D- 32) 
Elipstitution of the @© valtie of equation (D-50)) into Equatitonm 
me 29) gives 


Ze etre te ie ene) 
Mp CE RECA RE a(R) 





52 Sh’/(1-h*) +20 


E a(1+8) Oe 


Pie terentiation of Equation (D-33) with respect to a and 
Botting the result equal to zero gives a quadratic equation 


mio. ithe results are found to be 


a 8 = (oh g- fh? B' = l-h 
Teens ee hae Pea 








Peewostitution of the results of Equation (D-34) into Equa- 
tion (D-33) gives 


MIN MSE = a2 3°) = 92/8. (D- 35) 
a8 





This result has been tabulated in Reference 11 for various 
values of g*. For an illustration of the method, however, 
mie Optimal parameters for the Theil-Wage forecast model 

will be computed here, assuming that oF and o2 of Equation 


6 
Mmuel) are 25/3 and 4/3 respectively. 


e, ~ u(-5,5)> 02 = (5+5)2/12 = 25/3 
ie € 
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a 7 2 en 2 = 
Sy u( 2,2) Do; (Zale 2 Aes 


from which 


and 


mom Equations (D-30).. From EBauataen (D-b3) 1t follows that 


h? = -1/8 (16/100)+5(4/10) (1+.16/16)* = 0.182 
ee Sem 
Ee Sa 0) oc 


imese values of a and a' are those used in the computer com- 
maeeson Of the Theil-Wage model. These parameters will insure 
that th 


es . oe 
eel © omit ama t L meeesy 4: b, Cone 5 ac eee eho an 
=” a a 


.» 4 
—— at — mee ee ek ee te —_w + wb — hm te we — «= on 
r © 


“ 
ee we oe AL 


7 4'* 
wie ee 


Semcance with Equation (D-1) where the range on Ey is 10 and 
time range on Oy is (ee SUSIMeethen EeSUIleSnoOL Equations (l= ao 


memos noted that the min. M.S.E. should be approximately 2076" 


IE. BROWN'S ONE-PARAMETER EWMA LINEAR GROWTH MODEL 
Pe une soetle Ss uGenerd Elon Mode | 
Hieescrles seenerationemodel: Or ebrown Ss forecase 
rule is simply the forecast rule with random numbers applied 
as the shocks to process level and slope. Comparison with 
Pmemacion (E-5) will reveal that the forms are equivalent. 


The model may be written 


ae = 1G one 

Yue, +.b, + ef ee 
= tt 

er 











where Y, is the observation at time t, Y, is the process 


1 


eee leche i ener by ls thevpnocesseslope at stine si. amncdere 


A 
is the random shock observed as a forecast error at time 

te ey is a random shock experienced by the process level, 
amd Brown's forecast rule weimecsw ents Shock sine termicwon 

Bile) forecast error €iq5 Gis” iam. ei! is the random change 
in process slope which Brown's model assumes may be written 


= aoe This model is essentially the linear growth 
model in Squation (D-1) with Brown's assumptions concerning 
meme relationship of the various random elements. 
a. eune rorecast Medel 
Brown's forecast model as discussed in Reference 7, 
meeessentially a special case of the Holt-Winters model 
Meudabion .- 6) and Eeueeson (1-4) in whach he restricted rhe 


mamemd parameter to be a function of the first. The fore- 


@aoe rule 1S identical to Equation (D-2) 


wn 


Ps = ue ke by ° (Ee 2) 


mer llustrate the similarity of Brown's model to the Holt- 
memcers model, the latter model may be written in the ran- 


dom shock form using the forecast error as the shock 


eee ee 
Eawation (D-3) becomes 

‘ = i - Dey + ae, (= 5) 
and Equation (D-4) becomes 

b, = bey + lO" Ey ee 
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When Brown's double smoothing model is written in the same 


form [Ref. 7], the similarities are Gasily secnmas 


“A _ “A : 5 ; 
Me = ia + baa +c 8 Je, (E-5) 


b 


t * >o-4 * Cae 


iim Holt-Wanters parameter a, whieh smooths thempuocess 

Mevel an Equation (E-3) is e€quivallent to Brown's parameter, 
(1-8*) or a(2-a). The Holt-Winters' parameter product a' 

in Equation (E-4) is equivalent to Brown's a/2-a. When 

Ilese E€Quivalent parameters are numerically equal, then 
Emown's model will yield the same result as the Holt-Winters 
meg@el. The forecast model used in the computer program for 
this comparison, however, is the more familar from of Brown's 


dowbta smanqtt.: 
— eee ee te — «tw wr fw 


an Sess) Nacetees 9 
. ~ ~(2 
ou — QE 6) 
A ~ ~(2 
b, = & (Y, - ¥! )] fee 
where 

Ye GN mo (E-8) 

y £4) = oY, + py (2), Ga-o° 


Equation (E-6) expresses the estimate of the lag-corrected 
Meiement process level, and Equation (E-7) expresses the cur- 
rent estimate of the process slope. Equations (E-8) and 

(E-9) are the single and double smoothed expressions used to 
melculate the level and slope. The method involved in these 
calculations makes use of the known fact that single smootning 


(the simple exponentially weighted moving average of Equation 


Sal 








(E-8) }) lags a trend by a constant amount. The. double smoothed 
version in Equation (E-9) lags the single smoothed value in 

the same amount by which single smoothing lags the observed 
mend, Lt Equation (E>o0jeer. rewritten as Y, = ae of (y,-¥7)) 
mme term.in parenthesis tSprecoomtZeaeto be. they lagteounce. 
Mion required to give the Gumrent adjusted eCstimate of pre. 
cess kevel. Thesamount ot Tacs mhercitt. ime egquataon aac 

for trend series is the observed result of using past data 
fiemestimate the current level. This lags corresponds to 

he Waverage age" of the past data used in making the es- 


timate, and the error due to this lag can be shown to be 


e. = cb 
le B/ ie 
wmem@efsec the ecstimatcwert slt0pe Can St written ch Equation 
va (2) 
E-7 where e, = Y.-Y Browne extendas thus appredcen 
; a c ic 


fener to form what he terms third order smoothing, and 
mmenecr levels, but these forms are not relevant to the pre- 
sent comparison. | 
3. Parameter Estimation 

Brown advocates an empirical approach in "fitting" 
Mmmemrorecast to the series, but he also says that a=0.l1 is 
feeeeca Multi-purpose value. Since the Holt-Winters parame- 
memmevalues were taken from the literature as their best es- 
timate of a good value combination, Brown's value will oe 
taken as such also. While this value may be improved upon 
Ber specific series by experimentation, this superficial se- 
lection is in keeping with the objective of this study - to 


f[omecast vdried types of Series at minimum cost. 


Sy 








ie THE BOX-JENKINS POLYNOMMAT PREDICIOR = [HE GENM@RAT 
MODEL OF ORDER N 


1. The General Polynomial Growth Model 
The generating mode ieerom ewan ence bG.--)) onli 
Polynomial predictor 1S. thiesopt 1) aie ds locas ts cic 
Mee ctOr 15 discussed by Man yusemeen ec tc Gpenecu que linc 
weneral polynomial model specifies that each “derivative™ 
oemene underlying process experiences a random change in 


such a way that for the N order polynomial the model is 


maven by : 
eh) c 
ae We ~ (F-1) 
v7 levee Cen a aah 1) (ae : 
ie ma) Y, enon! Leas. lite Ck ce 
here agi) ) = 0 ang (he Giameaeecrromsec, ing yt) haye moan 
Bemo and variance o°1. Comparison of Equation (F-1) and 


Pametion (F-2) with the steady model, Equation (8-4), re- 
meals that the latter equation results from i=l in Equations 
fe-)) and (F-2). A similar comparison of the linear growth 
Teme Equation (D-1}, reflects that this form results from 
meerme i1=-1,2 in Equation (F-2). The particular model in 
Eeation (D-1), has yi): by and vit) = 0 but yt) Cou lral 
easily have had a positive value and nothing in that analysis 
wouba have changed except the complexity of terms in the de- 
welopment. 
Za OPtinal Propert1eomemncne | olynomial Predictor 

ror the assumed generating model the Box-Jenkins 

polynomial predictor can be shown to be optimal in the lin- 


sen Least squares sense and the optamal values of the 


eo 








forecasting parameters a; can be derived as functions cf the 


variances of the random shocks Ey and yt). 


et the Box-Jenkins result Gévivecdeomm eo 2 eeolnomOnmn chee 


A special case 


erence 14 will be employed andwreneemoe aure. (olor ean: 
Harrison on pi. 824 of Referencew/ sie besiscayro, shovwaenc 
mesult. 


Let a stochastic process by generated by the model 


Y i me (F-3) 


fea c=] ieee 


mmere the te, } have zerogmnean and are 1.denti cally (dis fib ces 
mmcorrelated random variables, and the i are €ONnsS tants.) Com, 


fader a forecast rule of the form 


A OO 

=e et (F- 

"941 Ga) 8s (F-4) 
oe : 


where the MS Are SeOllS talc. “Olin ce te rs ol rUe that 
Uses), 


a 240 z 


2 oe ay 2 
elle eee eerie || Py (n. 
the forecast rule will be optimal in the least squares sense 
when M = Te When thrsers trie we bquationw(b- 9). Imnplacsmirmane 
the forecast errors {e,} are identical to the random shocks 


{e 


a AiGmuencwic i Oremancuadl SOmUNCOMMe! ated ee bynSUCeGes sim c 
eretitucion, the Equation (F-4) form of the forecast rule 


tee be transformed in terms of the forecast errors as 


Yen le Ye d We ey, (F-6) 


where the iF are COs GinecemeNritine Equation. (Mo jm ined — 


ference equation form 
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Vea = ny a oes (F-7) 
j=0 
it follows from the previous analysis that thaise1o1 cea manic 


mS optimal for the equivallenteundewly iicectochtas tle ue ces 


ieee. =e We eeg t Vena, 


Since the forecast errors were equivalent to the random 
Baseks. Specifically, the forecast rule is optimal for a 


memes generated by the model 


-] . 
: J : 
Wem, 3 = ¥; Ste, * Veryy (F-8) 


where SJ is used to denote the jth multiple sum. Ditterence- 


ing Equation (F-8) n-1l times, Harrison arrives at the expres- 


ion 


(f) 


e (Eeo) 


ae = 2 Veena. 


which has no error terms beyond ec The result which 


aa le 
has been found states that if a random observation y has 
ie property that its nth difference can be represented sas 
memoving average process of iid variables 1¢,) which have 
Meno means and the process is of order ntl, then the Box- 


Jenkins n order polynomial predictor given by 


n-l 


a A 7 
—_ z = 
one a 2, ec (F-10) 


mm optimal and the te) represent the one-step-ahead fore- 


@ast errors for this optimal rule. 


Do 











36° Parameter Estimaeien 
The procedure used by hemes sons| Ret (cme isan 
section B-5 for the simple EWMA model demonstrates the 
Box-Jenkins parameter €Stimationmmwmeec dim ¢ enon sthcms ec ady) 
model. The optimal predictor for the linear growth model 
methe form of the general redienor recomended bysnolle. 
Pamters. Harrison has derived |[Ref, 7] the optimal parame. 


mers £Or this model as previously described an Section) D237. 


ie ne wReVactonship se tesuecer ala Caccs en ene: Genes 
Polynomial Predictor 


ine Stor ceastemodels spropecca sD y Oike- Natice tse ine imlee 
Peee, and Brown are specific forms of the Box-Jenkins Poly- 
Mmengel Predictor. The demonstrate the relationship, Equation 


fe) can be written in the form 


: = <(i) 
ee a y ss (F-11} 
eel 
where 
6). BGG) sae ae 
t 4 t-1 ieee 
and 


imis form resulted from expressing the ee in terms of the 
ewmeeors and substituting in Equation (F-11). 
a. The Simple Exponentially Weighted Moving Average 
The first order predictor, where n=l in Equation 
(F-11) causes that expression to reduce to the simple EWMA 


model 


me 
i 
Re! > 


ti c 
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E<1> 


Simei Se 


where equivalence to Eouawilonm( B35) 2smsco nm bagec tis cantemom 


for the error ina terms mote nemo. 7) clones (ome bOmcea sie 


i = al = ay, emo) Yye 
b. The Holt-Winters Linear Growth Model 
When n=2 ine bolatvonrs Or lL) thes second onder 


meedictor becomes 


= Y + 
ot 
aa + 5 - 
en ee 
= + ' 
b, bey ate, 
where y(4) 3. irigtenm 26 I 


c. The Brown Linear Growth Model 
BEoOwn. S SeCONdmonmacr Redd CE Oi cman mien: tiaewleais 
mommeOof Holt's, where the two parameters oa, a@' are restricted 


mombe functions of the discounting parameter. £, 


a 1-62 


Gaaek 


qa! 


ic ict om lbuicar Grow llmiede t 
Lic eticW@iata ccm MoO nClOommeMmest. TCLS. Ulnemmal © - 


Winters Parameters so that 


oe 








III. RELATIVE FORECAST MODEL PERFORMANCE COMPARISON 


A. COMPARISON METHODOLOGY 
1. Time Series Generating lege ioapcc tamed tiom 

When forecasts of a particular time series are at- 
mempcted, the fLorecastéer's beiieteconeouming see sundenis sane 
generating process governs his selection of a specific fore- 
@ast model. Alithough recognizing that few models completely 
m@aceribe the complexity of practical economic or physical 
[Mmereesses, Dy his selection of a forecast model the fore- 
@eoter thereby indicates that the time series has an under- 
lying stochastic process whose functional form is suggested 


Dmyeetme Lorecast rule. The adaptive parameters chosen for 


h 


~~ - . ple wv nar - e@erre Om oa 
a cA, aiw CAD ao? VAsla WS We 


rm ew Sad 
Vwvwes a — 


~~ - => See 


che Sete ra 
mimeeprocess. The degree to which the actual underlying 
process differs from the assumed form is reflected in the 
forecast accuracy obtained by the fcerecast model. 
ae  Borecast Model Speciticatwen Error Measurement 

Any comparison of relative forecast accuracy is 
fundamentally an attempt to determine which of the forecast 
Models is the more accurate specification of the process 
Moiemating the series being forecast. The measure of speci- 
fication error used in this comparison will employ the method 
discussed by Bossons [Ref. 13], who defined specification 
fwenor as the additional variance of forecast errors introduced 
Peamisspecification of the generating process. This measure 


cannot be determined when comparison is attempted using actual 
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time series data, since the precise underlying model is un- 
known. Since the various series examined in this compari - 
son have been generated from known process models for which 
the optimal forecast model and parameters are also known, 
mepis possibile to determine 

ESRI i oe 

VAR(Y, -Y#) 

as a measure of the model specification. If ta} is the 
series being forecast, then i aes vs ule) S€CrIeS 802 sho recaseues 
generated by the forecast model whose associated specifica- 
tion error is being measured, and Oe 16 4 S€vies 2 on ulna 
(minimum asymptotic variance) forecasts for the series ic 
The lower hound on f is zero. and is obtained when ees = 
ees . NOwUpper bOUNd OM Eeexi1Sts<) POSitive © Valliesere: cer 
the extent to which a particular forecast series has been 
degraded by misspecification of the underlying stochastic 
mocess. This measure, as Bossons [Ref. 13] has observed, 
[eeomtwo uses. First, it permits the effect of a Known mis- 
Specification, such as a model simplification, to be measured. 
This emphasizes the relative importance of various coeffi- 
meats Or parameters in the model, and its sensitiveness to 
mimee., i oe€Cond, it permits the robustness of a forecast 
medmel to be measured by reflecting the forecast accuracy 
Meevarlous types Of Series misspecifications, such as cor- 
Mmeeeotion, linearity, or for specific distributions of the 


random variables in the process. 
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3. Forecast Model Per so mmmamee = Gagiacumlond 

The measure sot modemispecem teation Crmem pemircs 
a preference ordering or VanieeioweetOneceas pemodc lou Pomme 
made for any given) time series egeneratiom mode laws itis 
erecen true that a collecetoneemeute se. 5c nlhesu snc mote. 
east, and few of the™series are@mepresented by wany one 
generating model. It would, of course, be possible to anal- 
wae all the series and groupsthem according to these process 
Mmemationships, and for some processés this expense 1S justi- 
mae FOor’many series however, as mentioned in the introduc- 
mmometoO this study, it 15 not critical that the forecasts be 
eeeecedingly accurate, and the forecast costs must be kept to 


a minimum, consistent with the benefits obtained from such 


— 


ze ae ee E ~ oe 
bean so x. 


TOfecasis. Ah ad@itronai heahiS of mewsurene NETSTOTE , 
memeecded to permit a preferred ranking of forecast models 
meer ad COllection of series to be forecast. 8It may be true 
that one or two forecast models may provide the necessary 
accuracy over the entire collection of series. However, it 
immerecognized that this 1s extremely situation dependent. 
iememmethod used in this study to suggest possible “best” 
fmeceast models for use inwpredicting a collection of dis- 
wimebar time series is the calculation of the average speci- 
miecdt1On error over all series forecast, and the sample 
Mereeance of the specification error. Selection of a model 
Peeed On the estimated mean specification error would, of 
eeurse, imply that a few forecasts which were grossly erro- 


Neous could be tolerated, while selection based upon esti- 


mated specification error variance would suggest that a 
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uniformly high level of agen mires soe eed Came emuicE 
no extremely poor forecasts) Wemewacceme lc OMcmeconbamia 
tion of the two criteria may gememebc seommdc nec mic con- 
ebusions of this study will be restricted) to rankings in 
terms of the mean and variance of specification error. No 
voleed general interpretation Cansbe given to these conely- 
Samons, Since they are applicable only for the class of 
me@els and distributions chosen for use in this study. 

The method would, however, be applicable to the 
relative comparison of a group of forecast models when 
jfem@ecasting actual time series, if one were willing to 
assume that the parcicular=model wathethe least mean square 
Memeeast error was "optimal" for a particular series. Even 
eee SUCCI LACE LON eeror based.cwly ween <ho “eesot! mode 
rather than upon a =sruly Optimal (minimum Yartance error) 
fore it would still be possible to draw meaningful con- 
mimerons concerning the relative effectiveness of a group 
of models. The same approach would apply when searching 
nome general purpose parameter for use in a single model 
fweeremust be applied to a collectiom»of series. It is un- 
Mieeey that an optimal parameter for one series will be op- 
mee tor all. Use of this method on a representative sample 
meee r ics would facilitate selection of the parameter which 
fimmizes the average forecast error variance or some other 
Bemected criterion for the entire collection of series, and 


Meme just for one particullar series. 
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4. Time Series Data Generation Methods 
a. Parameter Selcemuom 

For each of thepterecas tamode ls di -cusccaern 
section I] a time series was generated wsing the underlying 
Beocess generationsmodel, assogratcdaymren taal Speclilte 7one. 
mact rule. The random shockerornnsmers tioceerulles sole gato. 
emmere that the parameters, such as intercept and slope, be 
Specified and that the random shock be added to provide the 
mmochnastic, element for the series. Jt was determined during 
mmeecourse of the study that the variance of the random ele- 
femme weaused little or no change in the specification error, 
mmo attempt was made to produce results over a range of 


meme parameters. The reason for this was that, even though 


PeerTstwETMT Tariana was Cnatigoa t@e aligmedcis, it as 
mmameed in generally the same proportion for all and the ratios 
mapained approximately constant. In no case would the rank- 
mee tiave changed due to the parameters selected. Parameters 
Mmeead tO Obtain the representative results contained in Tables 
ieaend I] may be determined by consulting the computer program. 
b. The Random Number Generator 

The random number generator upon which all sto- 
Mimestic series properties are based is a function called 
URN which is contained in the Naval Postgraduate School IBM 
eev-O7 computer. This additive generator was selected as a 
suandard instead of available multiplicative generators or 


the conventional RANDU since it was almost three times faster 


than RANDU and had been subjected te statistical tests which 





were on file at the computeneraciibt aol 
known quantity, questions invelyingeebasegeneratoreanasiEs 
effect on results should be quires wae - oy cdg phoWeean 
dational statistical testime gorse mmo wome 
c. Normal Random Number Generation 
The normal random numbers used with the Least- 
squares Models were generated from the uniform (0,1) URN 
Mieput by using the Central Limit approach outlined by 
ilor |Ref. 8} on pages 92-93. This amounted to summing 
fmvelve unitorm (0,1) numbers and subtracting six to produce 
a normal (0,1) number. 
d. Uniform Random Number Range Transformation 
They uniiterm random mumbers werestrans formed 


Memvarious ranges {page /9%, Kei. 8yJ using the exoression 


Lee Sg (B-Aje, Oca al 


mrech is a rearranged form of the uniform cumulative distri- 
Becton function. Since A = -B in this study, this expres- 


Sron can be written as 


ne = (2e,-1)B = (e,-0.5) 2B 


mere 1S the form used in the Fortran program to transform 
the random numbers to desired ranges. 


S olngle ange usie cerbess Forccas taper lormance Com- 


parison 


a, Joing le semiecmeonnarison 
After a time series was produced from one of the 


generating models in the computer program, all forecast models 
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were used to forecast each obsSenvedscemmec sv alve. one imei 
past values. After cach foreceas tetie mie neecc Geet) oem 
stored and after all models hadWeompietced torecastine tie 
series, the average forecast error and the sample variance 
Mel s error were calculated: yeiomet Whos tinic so amp Lome ce 
mermacte of the specification error {i} discussed in Section 
Z above was computed for each model. Table I contains data 
Mmemerepresentative Comparison made using this method of 
ieasurement. 
b. Forecast Comparisons Using Several Series 
Miichieuner Ss Ime LomScrle> —cOmmaint sens mad neen 


memoleted, the average specification error and estimated 


Jo variance were then calculated for each forecast model. 


W" 


amr 
meron is the performance criterion discussed in Section 3- 
eeaemeted there, the results may be interpreted only in xe- 
lation to the specific series combination examined. Table 
meiecontains representative data for comparison of series 
bee this criterion. 
fA emperecast Model Stalmmiazation and Operation 

A stabilization period of 100 observations was used 
momeGemove any effects due to improper starting conditions 
moomunen the forecast error was compiled over the next 300 
M@eservations. the specific initial conditions for each model 
[meen were used to obtain the representative results in 


Tables I and II may be determined by consulting the computer 
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program, Sufficient CommelG@smiavc yoo non ide de Gem tars dat 
in identification of program components and the variables 
used in each. Although tihegresuilt- wr eenesen ee om sane 
estimates of average forecast error and forecast error 
variance, the number of observations forecast was considered 
large enough to provide a reasonable estimate of the actual 


values. 


lee COMPUTER COMPARISON ANALYSIS 
ieee rher Peri ommtancCe i 6De er ames 

[hemrorecastemode | Sweonpaned Weresseclcencd swat. 
@eeail a prtort relative outcomes in mind. Due to the 
Mercure Of the assumptions on the models and the generated 
Serres ass@ciated with these models it was anticipated that 

a. each model would be "optimal" (have the least 
Saemiaced mean Squared eGrror) for its corresponding time 
Series. 

b. the modified least-squares forecast model would 
Beoguce Smaller forecast errors than the simple least- 
mameses model due to the correlated nature of most series 
used in the study. 

Gy Gite Ome Cas Commo Cmeat CC Dae ec SUN) ec a riNiin 
model would tend to lag behind the linear growth processes 
by perc latively constant amount. 

d. the Cox-modified EWMA would tend to track the 
mancar models better than the unmodified model. 

e. the Holt-Winters model would probably perform 


Better overall than any of the mode}]s above since it is 
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Suitable for both the auto@conmelarcdiaa ta gand enorme 
linear model used in five Of eheegener tere npmoeocac oe 

f. the Theil-Wage model would have the same 
eeneral characteristics as pthc Hole tan tersenodclaabug 
puobably provide bettemresponse sromenoecss me man ges maulc 
jo their use of a more “simultaneous” approach (use of gthe 
teet recent slope rather than the wuse cf pine slope caleu- 
Iated last period) than that used by Holt and Winters. 

g. the Brown model would have generally the same 
Mmaracteristics as the Holt-Winters model, but not perform 
G@uate as well due to the restrictions which Brown placed 
me rorecast parameters. It is argued by some [Ref. 7] that 
Brown's more parsimonious model can achieve essentially the 


ve ym ee om tee oe tas ~*~ 
wah Le NCA ae tS oD das py 


=— oo 
mm» Ww 


ctzce ay fhet prodmaacd dy @itiar Che sic! T- 
fimbers model or the Theil-Wage model. Quantitative evi- 
eee tO Support or refute this claim was one expected result 
omnis investigation. 
ye Forecast Medel Performance Comparisons 
a. The Least-Squares Series 

line Veastosd la recmnOoreceact anode lmaie immo mile dabiern 
@eoethan all others in predicting this series, as anticipated. 
Comparison of the process variance of 9.13 (see Table Ii) 
Pee the forecast error variance of 8.98 tends to confirm 
meee the least-squares forecast model produced optimal pre- 
mmetions. ihe next best forecast model for this series gas 
Beewn's double smoothing model with an 11.4% larger fore- 


Gast error variance. 
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It may be observed (Table I) that the modified 
least-squares model was ranked fourth a@iter the Holt-Winters 
model. The unnecessary (eominec tate te eoneiee eave Oren mene 
random shocks degraded the quality of fenecasts penerated 
Iya this model. Note also that the sample EMA torecaes 
meael lags the observations by =>. 0S50—"tsee Table 1). thas 
fPoeesmeexpected Since this model specitics Eat the forecase 
methe next period {or any future periodj is the current 
ievel of the process, and slope of the linear model was 
Semected to be 3.0. The EWMA model was thus never able to 
Mmereipate the change due to slope. This is the refinement 
incorporated into Brown's double smoothing method and it 
Mrisears to be effective in that model. 

b. The Modified Least-SquaTres Series 

Tice Gesultece lO Mbasoe sel Les wien mlUGh ENomacne 
memcor the simple least-squares series except that the least- 
mamtees models reversed their roles. The modified least- 
Squares model produced approximately the same forecast error 
variance (8.98) from the correlated series as the least- 
Seuares model had obtained previously on the uncorrelated 
Series (see Table II), and the least~squares model produced 
memest the same specification error for this series as the 
modified model had obtained when forecasting the uncorrelated 
eeeres. the change from uncorrelated to correlated normal 
random shocks affected the other models in varying degrees 
(see Table I). The least-squares model and the Brown model 


appear to possess equivalent capabilities to forecast the 
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correlated series, while the modified EWMA model continued 
to be the least desirable for Wiseminwrorcesas tice heme ase em 
Gc. lhe Simple EM gs ius 

The simple EWMA model, although its forecast 
emror Variance was not as Jow as stiemecercs V4artanecmusce 
imiele JL), gave™the least forecastmewver Varrance for sens 
semies. Almost all models seemed to be capable of forecast— 
Mmimeehis series adequately, but the fheil-Wage model was the 
mes desitable by far. | The non] lineaumry  .on sunisuccrmes 
ereame noticeable in the relatively poor performance of the 
least-squares model, but the effect was not pronounced due 
to the limited range of the random walk in the series gener- 
ating model. The modified least-squares model was more 
CaPavle Vi LUTECaStiny inis series auc TG its avbiiity to 
meeethe addéd information contained in the series correla- 
een). 

Ga ioe oda Teas Ewin sSerares 

The modified EWMA forecast model developed by 
@eeeecenerally provided the least forecast error variance, 
beret may be observed (Table 1) that the modified least- 
squares model produced almost the same results for this 
Series. The modified EWMA model does not share this versa- 
feerty when forecasting the modified least-squares series. 
Mines next ranked model in terms of least forecast error was 
the simple EWMA model, but its error variance was 18.4% 


greater than the modified EWMA model. The modified least- 


Squares model provided a 0.006 specification error during 
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this particular compari siomee bu teoumeo eile (oer yc ke eeeecae 
slipht negative error implying that 2 eer Ormed spelt rer ata 
the "optimal" model. Basedpongthessamumlarion 16S Uist eaenle dee 
appears to be no real ditterénce Simeon -ecasteaccula ce aaace 
gardless of which of these two models were used. Reference 
wen lable Il weflects thatethese two medels were able to xre- 
agmee forecast error variance substantially below that ob- 
Eiwavicd in the series. This suggests a truce predictiveseap— 
molity not possessed by the other models whose forecast 
“eeor Varlances were each approximately equal to or greater 
fiam the series variance. 
Ce iowIOlt ss Mito rs lane amuGrawt We oct les 
Ne WHO ie eminu ete manO te @ toi soa cll achieved the 


Tan at eR Fev ce fy. wt wen we AT ©. "a »>-.-e¢ 
AN GUY & AW eae EDS we nwa ew ok eee 


as) ° neem 94h THES negiar- 
mance was only slightly better than that shown by the Brown 
medel (see Table I}. A few comparison trials have resulted 
ieethe Holt-Winters model obtaining a smaller forecast error 
Waneance for the Brown growth series, and the Brown forecast 
mecel demonstrates a similar capability to perform better 
Mie tnc Holt-Winters medel on the Holt-Wanters seriess 
ifese outcomes were regarded as sample variations, but the 
implication is obvious. The results of these models are so 
comparable that it would be difficult to conclude that any 
real difference existed between them (for this series). The 


meme Dest performance (the iheil-Wage model) resulted in a 


feo, increase in forecast error variance. 
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{f. The Thei)]-Wagewse ares 
The Theil-Wage forecast model proved to be 

distinctly optimal for forecasting ese issiicastnde mia aig 
process. Previous comparisons have shown that the various 
ppbserved series could have been gemewacede by several esa alia 
different models, as evidenced by the comparable forecast 
mertormance of the several forecast models. Here, however, 
mgemext best forecasts were obtained by the simple EWMA 
mee! with almost four times the forecast error variance, 
iro minimum error variance of 18.14 (see Table II) exhibited 
ibeethe Theil-Wage forecast model is much larger than the 
memes Valtronce Of /.-99 "but 1t Compares favorably withe enc 


Meereted theoretical mean square error of 19./ obtained by 


fm — AN 
: wie 


i Peo oe oe a #8 
A. wyutreawas Nd aw? ° 


Cee ilcms gO WiimiehileddearG rOW Ul semene s 
The results obtained while forecasting this 
series tend to further reinforce the observations made con- 
Gerning the Holt-Winters results. The Brown double smooth- 
meemodel obtained the least forecast error variance, but 
mie Holt-Winters model only slightly exceeded that minimum 
mmc. Other modells tended to forecast this series Some- 


what more accurately than the Holt-Winters Series, but the 


same performance ranking resulted (see Table I). 
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IV. CONCLUSION AND RECOMMENDATIONS 


A. CONCLUSIONS 
1. Validity of Assumptions 

Throughout this thesis itebas been Stressecds ena: 
meme tinal conclusions would=necessarmly bemgeneral in na 
pure. The assumptions which led to these conclusions must 
meme pe overlooked, for some of them may place significant 
Mestrictions on the applicability of the methods studied. 
Prethese assumptions are changed, introducing other dis- 
tributions or parameters, the methodology introduced here 
meeequally valid in those circumstances. 

SOMeCESPCeIMIG -aSsulpieron Which ane thought. £o 
Seree. Vic Ceonmeiubions iff heme Wamretreaec: 

Ae ileseOmPositiloneor the —sSselectedmo roup On mine kes 
wiaeemodelsS: “Some models not considered here may have proved 
weremor to adil of those selected. the conclusions there 
meee are applicable only to the specific set of forecast 
moeaels treated. 

Deters pecci fic parameters seleeeed MOT sc aGa 
forecast model. Winters and Brown have recommended certain 
wees fOr wse with their-models for general purpose ap= 
pegreation. No such recommendation was found for the Theil- 
Meee model, for example. A specific series was generated, 
and the optimal parameters for that series were used for 
pemee Series. Perhaps a morewceneral set of parameters for 
the Theil-Wage model exists which would have made its per- 


worMance Siperior to the other models. 
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c. The use of the uniform distribution and the 
range selected for each may have had significant impact 
on forecast model performance. These distributions do not 
mecessarily represent any physical omeececononi ce process 

dj» Finally, it must be@remenbercd sehat, these 
conclusions result from simulated time series data where 
ie generating parameters were accurately kmewn, and no 
Sweeping claims can be made for the results of any simula- 
fen) T)’ 
miele it 1S perhaps proper to be skeptical of the specific 
conclusions to be made here, it is again suggested that 
moen better assumptions can be made in the context of a 


preoolem, and when this comparison is repeated, the conclu- 


_ 


ee 2 a ne, Ch ol! &. “seem omc S sities lel” alate S07) wamt a. 
ijfeak value to the forecaster. 
fee conclusions and Applications 

Based upon the representative results in Tables I 
omg@eetl, and the analysis in Section III, B, the following 
conclusions are made concerning forecast model performance 
momeetme tested series: 

a. The use of the least-squares model and the 
modified least-squares model for forecasting the Holt-Winters, 
ittteme-Wage, and Brown series gave poor results, primarily be- 
cause these series tend to be non-linear for many of the 
eljeosen ranges of the distribution of the random variables. 

In attempting a "non-discounted" linear fit to data which 


aepear quadratic over large periods, enormous errors result. 
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The lesson here, if One May be wnotncd yes tia bce Comionees 
cast model such as least squares must not be applied to data 
which have a tendency to Demmon— Pitesti ste escuela males 
suspected, the "discounted" (Vamem sede l cee c euCm ep me hem 
Med, since they tend to fit themdatamon)) socal) aya pee 
Meme distanteobservations @e1venmre lamvciygelittic weigh. 

(b) The performance of the Holt-Winters, Brown, 
and modified least-squares linear models on stationary (no 
Mmaemda) data is good, so unless no question exists as to the 
Constant level of the random process it would appear desir- 
pikes tO Use a linear model. In the event that a trend oec- 
mes, the model will follow it well, and if not, it will 
meme cive good forecasts. If a series similar to the 


=~ ft rt niiide lacie Eo aos [ft a te as =~ ee = = wa eee ee aT: 2 7 = . > i” 
Awe sasttase 2O 4+4inury LS... ow CiboUuUIlLeociou, Cie tO rterr row 


F {5 


modi 
Meee Sduare 15 to be preferred over the Holt-Winters or 
iPaewn models. This model is distinctly superior to all 
mamers when only the first four series in Table 1 are ¢on- 
perored. One reason for itS Superiority over the standard 
Memist-Squares model 1s that the latter can generally only 
Memexpected to have, at best, a forecast error variance 
eemal to the variance of the process about its mean. This 
iemaue to the modell's attempt to forecast the mean value 
Oummene Series (the least-squares regression line). The 
fiematied form further extends the simple least-squares 
model and adds a correction factor based on the known cor- 
femation and the last ferecast error. With this added in- 


formation its forecast capability is much improved. That 
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this is only true when the random shocks are correlated, how- 
ever, May be seen £romelapl owe 

c. The Modified EWMA Model was designed to permit 
Wiener's linear predictor to adapt to changes in process 
evel. It did not appearvzvo achieve tiis goal Very citec- 
mincly, since the simple EWMA mode bipermmonincd pcetcrecn 
every series except the one for which the modified model was 
intended to be optimal. The data tend to suggest that the 
foe modified model is a special one with limited adaptive 
Sapability when applied as a result of misspecification of 
memunderlying model. Tnis, of cotirse, 1s not in agreement 
fee the prior expectations of this model as stated in Sec- 
maemeely Bb. 1, but after some reflection 1s not very sur= 
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change in the mean level of a random walk. The rapid changes 
weemeh occur in the linear model would not normally be expec- 
ted to occur in a random walk process, or the walk would lose 
its random property. Therefore the model was not intended 
momeOllow a linéar trend, and without further modification 
Saemd not be used to attempt this. 

Ce Tics Gestltss—n Pane f= lead to ay Conelusiom 
that the Brown and Holt-Winters models are comparable, with 
meevn'sS model showing slightly better overall performance. 
iis tends to support Harrison's claim [Ref. 7] that Brown's 
(eee 1S preferred imepwaceice due to 1ts simpler conmstruce- 
tweon but comparable result. 

e. The measure suggested earlier in this study 


ea) average Specification error, and specification error 
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variance in selecting the best models tends to bias selec- 
ielk@ 7 favor of the Theil aWage “oreceds tanodel (cece. fapile 
Iii}. The reason £or this set haa eon etc cee or 
perform as well on all other series as for instance the 
Brown model, the other models almost completely failed to 
mollow the Theil-WNage series ges age oll ee eiicw a lalanee 
miles average of Specification error were amilatews tor all 
other models. The uniqueness of the Theil-Wage series, as 
evidenced by the relatively poor showing of other forecast 
foe ls in predicting this series, 1s an excellent example 
of the need to make such model comparisons as this study 
Mebmcone. lt one were nestricted to using the other tone; 
@eemmodels for predicting this series, 1t might be thought 
ee OTS Se Ss WEE CSS Vinson t an ate Gimetweheons to De 
mecurnmatcly forecast by any model. When such a series oc- 
ment practice and none of the standard models seem to 
apply, a comparison of widely assorted forecast models may 
ameorest a more appropriate form for use. 

An application of the comparison methodology pre- 
Bemecd in this thesis might be made by a supply item manager, 
who is responsible for forecasting demands for stocked items 
aieminsuring that stockouts do not occur more frequently than 
some specified rate. The manager could select sample demand 
data which was representative of his stockage items, or if 
the differences in demand distributions for some items were 
too great, he might form two or more homogeneous groupings 


from which representative series were taken and select a 
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mode let Oreeaene The forecast models could then be used to 
forecast the selected series and the measures of specifica- 
tion error calculated using the eas t Meemece asec Frome. 
ance model which resulted.” Of Secours eemec er orceds (rece mmmapae 
muse at the time of the comparidseonesmemma alse spe aneluded: 
If the method is a good one, this comparison will demonstrate 
clearly how good it is in terms of the added forecast error 
measorved in using other less applicable methods. (he anter- 
Mreeeation ot 100 times the specification error as the added 
mmectitage of forecast error variance caused by model mis~- 
Seeecification pie beveads ily undernseood iby al ieeuine ses m. 
pomeved in modei selection. tJdhis approach 15 recognized to 


pomeeerictly empirical, but for mass producing forecasts on 
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not be justified in many cases. 

In the event that no model appears clearly superior to 
Meiers, the comparison results still permit an intelligent 
tie@el Selection procedure. Consider the results in Table I. 
feeomevident that whem the linearity, serial independence 
and normality assumptions are satisfied the least squares 
Memiod should always be used. Uncertainty about the satis- 
faiewion Of these assumptions poses an interesting decision 
problem. If the least squares forecast model is used and 
M@emoenecrating model of the forecast series is actually as- 
sociated with one of the other forecast models, the forecast 


Cmmeor Variance "penalty™ for use of the least squares methed 


ranges from an additional 18.3% minimum to over 650,000%. 








On the other hand, if one were to select the Brown model, 
the "penalty" would range from 11.4% if the least squares 
model should have been chosen, up to a maximum of over 2300% 
Moa worst case. For six Of Sthewsevemepogey lcescriece 
however, the Brown model would result in less than a 25% 
Bemalty. The "max-min" solutiom suscested by Table Tas 
the selection of the Theil-Wage model, which never results 
ime FOrecast error Variance penalty greater than 11353 oF 
ieist Over twice the error variance, no matter which series 
/metorecast. It may be noted that this model, though, ali- 
fees Causes at least a 60% penalty unless it happens to be 
miesoptimal model. If the forecaster had reasonably good 
mmeerination on the likelihood of occurrence of the various 
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Variance, a decision rule could be formulated to guide 
Miemecclection of a preferred forecast model. 

Eiimeacddi tional application which jis actualiyvonty a 
Weebation of the approach used in this thesis, is the modi- 
Piredt10On of various generating models to introduce varying 
dégrees of autocorrelation (or lagged variables in the least 
squares models) to determine their relative effects on the 
forecast models. Previous studies have shown a negative 
bias in variance of least squares parameter estimates caused 
Maat ocorrelation. A megative bias in the estimates them- 
Selves occurs when 8 > 0 in the lagged variable case. These 
meoults may be shown analytically (p 211-221, [Ref. 12]). 


The studies have gone on to show, through simulation, that 
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a strong positive bias occurred when auuccerrelation wand 
lagged variables were both present. Such investigations of 
model interactions could make use of (inewmeenodeliem aac -— 
Seribed in this thesis 45 a quantitamlyesmeacure so! Success 
ama further add to the present simiders wanes OL ecCOngmm«e 


time series data. 


B.. RECOMMENDATIONS 
ite EXtensions O01 this Invest caeom 

Some recommended extensions cf this thesis which 
may result in improved forecasting models or a better fore- 
meen model selection Criteria are: 

an) Node termination Of se nemecmmce COmmriLe Tectia 
Meetnis study of distributions other than tniform. 

b. Investigation, along the lines suggested by 
Peri kef. 5S], of the advantages of replacing a in Equation 
feo by some other form of moving average. 

[tevoula De antemes tinge tomde Ce hiiiemwine Enei. Ge — 
G@merements such as minimizing the effects of long term trends 
could be used to choose between these alternative forms of 
moving average. Limited tests at the close of this study, 
where Brown's double smoothing model was substituted into 
iopes modified model instead of the simple EWMA model nor- 
Welly used, resulted in significant improvements in fore- 
casts of series from the linear generating models. (Excluding 
memelmetl-Wace S€Tr1GS meme uaverage Specification Crror wads 
Mmeroncd from 1.58 to Ueoc. } 

€. Investiegtwonsat “tracking sigmatsce When swen 
misspecification occur such as using the Holt-Winters model 
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to forecast the Theil-Wage series, a model modification 
which has been suggested by some [Reti. Ojo. 17 tals) es 
the use of a tracking sign@leto cemvemas een meceec pitenm® 
Management that the forecast model 1s emeteapleuro pertorm 
satisfactorily. The forecast Cryrer stole tanec camses 1p — 
Mealwmay béwset at any level needed ae such signals may be 
used to obtain the attention of management, or as brought 
gimein the references given, to adjust the smoothing con-= 
Ssaaeseto accommodate the serres. this procedure probably 
fevsethe most potential for handling the wide assortment of 
meamaem process forecasts which is often required. The cal- 
culation of “optimal parameters" is obviously not a solution 
Muameertiic Variety of Seérics emcountered in practice» Em- 
anerelly omog" “mar ameescs sur 
pemmenters and Brown have done, fails when gross specifica- 
fliemeerror occurs, but a combination of a “good” parameter 
pmigeeas tracking signal adjustment would appear to be an ef- 
meement Solution to the problem. AS an extension to this 
mois 1t would be imteresting to determine the degree of 
improvement gained by the addition of tracking signals 

to the models. Although such signals have generally been 
oeeenissed in the context of EWMA models, the concept very 
likely could be applied to least squares models and improve 
their performance in those cases where the model assumptions 
See violated. Successful application of such refinements 
wemld contribute substantially to a more “‘automatic" fore- 
@isting system and imerease the population of time series 


for which any particular model may be successfully applied. 
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Z. Application of mfetnodonee, 


While it might be pnematieg Gem; een 
actions be taken on the sample results obtained in this 
thesis, 1t 1S maintained Chat (Ghee pieeedumemUecds scour 
and could be applied immediately to a practical problem 
moing actual data. Slight modifies uvons nus eee made aus 
ine Fortran program such aS substituting “read” statements 
for the series generators and a logical check added to 
iewermine the model with least forecast error variance for 
mepccitfic Series. The program would then give results 
which could be readily interpreted by forecast personnel. 
It is strongly recommended that NavSup or any other agencies 
teume forecast models give consideration to use of this 


a 


MeCnoudiogzgy aS an EVaLlUation of 
mecdel: kf the quantitative measure obtained justifies con- 
med use Of the same model, then the procedure may be 
fmepeated uSing Only versions of the same model with varied 
DemeametTers aS a sensitivity evaluation on the model. The 
small amount of computer time required to perform a com- 
peamrson (less than 30 seconds on an IBM 360-67) or sensi- 
Mmmemey analysis is trivial compared to the potential increase 
iimerLectiveness of forecasts if it is discovered that some 


Other model or combination of models are more satisfactory 


ipmeatetOrs Of the random processes of interest. 
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Squares estimation methods and five employing variations of 
memes exponentially weighted moving average method, are com- 
pared in their relative ability to produce minimum error 
Memmeranee LOrecasts for seven simulated time series. Each 
series was generated to enable one of the forecast models 
to be the least squared error predictor. A comarison 
Meeiodology is developed which facilitates forecast model 
performance through the measurement of model specification 
eeeors. A computer program is presented which may be 
meet11ed CO accept real time series and which permits the 
memecast models to be ranked in order of their relative 
Specification error. 
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